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PREFACE 
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of Agriculture, the National Aeronautics and Space Administration, the National 
Oceanic and Atmospheric Administration (U.S. Department of Commerce), the 
Agency for International Development (U.S. Department of State), and the U.S. 
Department of the Interior. 

The work which is the subject of this document was performed by the Earth 
Resources Applications Division, Space and Life Sciences Directorate, Lyndon 
B. Johnson Space Center, National Aeronautics and Space Administration, and 
Lockheed Engineering and Management Services Company, Inc. The tasks per- 
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e P. J. Aucoin and Susanne O'Brien of Lockheed Engineering and Management 
Services Company, Inc., for software development and testing. 

e Rigdon Joosten of the National Aeronautics and Space Administration, for 
technical support and comments. 
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1. INTRODUCTION 


One objective of the Renewable Resources Inventory (RRI) project in the Agri- 
culture and Resources Inventory Through Aerospace Remote Sensing (AgRISTARS) 
program is to Investigate the feasibility of using remote sensing analysis 
techniques for monitoring nationwide forest and range renewable resources. 

The Current Technology Assessment task. Involving research, development, test- 
ing, and evaluation, is part of this project. 

Two automated data processing systems have been examined to date: 

• The classification systems developed by the Large Area Crop Inventory 
Experiment (LACIE), a joint endeavor of the U.S. Department of Agriculture, 
(USDA) National Aeronautics and Space Administration (NASA), and the 
National Oceanic and Atmospheric Administration (NOAA) of the U.S. Depart- 
ment of Commerce. 

• Portions of the Resource Information Display System (RIDS), which was de- 
veloped by the Geometronics Development Group in the Washington, D.C., 
office of the USDA Forest Service for application in all forest regions. 

The purposes of this task are to evaluate the system developed by the Earth 
Observations Division (EOD) at the NASA Johnson Space Center (JSC) and the 
Laboratory for Applications of Remote Sensing (LARS) at Purdue University, and 
to determine its utility in supporting RRI project objectives. The following 
are specific objectives of the task: 

• To evaluate the Iterative Self-Organizing Clustering System (ISOCLS) and 
CLASSY clustering algorithms for forest land classification. 

• To determine the utility of selected clustering algorithms for analysis of 
forestry and range study sites and subsequently to incorporate the classi- 
fication products of these sites as one of the overlays to be used in the 
RIDS. 
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1.1 BACKGROUND 


Forest and range managers require accurate and timely vegetation Inventory 
Information, such as species composition, density, productivity, and condi- 
tion, to make sound management decisions. Data gathered by satellite multi- 
spectral scanner (MSS) and analyzed using various classification schemes may 
help achieve the Inventory goals of the AgRISTARS program. The EOD version of 
the LARS System (EOD-LARSYS) has several classifier options that can be eval- 
uated to find the best one for forest classification. 

1.2 SCOPE 

The scope of this task Is to determine how accurately forest and rangeland 
classes (U.S. Geological Survey - Anderson) can be Identified using ISOCLS and 
CLASSY. If one of the algorithm? can accurately classify forest land, It will 
be a useful classification tool tor forest and rangeland inventories. 

1.3 APPROACH 

To address this task, the two algorithms will be applied to forest and nonfor- 
est classes for one 1:24,000 quadrangle map of northern Idaho. The classifi- 
cation and mapping accuracies of the classes for ISOCLS and CLASSY, the two 
algorithms to be assessed, were evaluated with 1:30,000 color Infrared (CIR) 
aerial photography. Confusion matrices for the two clustering algorithms were 
generated and evaluated to determine which one Is most applicable to forest 
and rangeland Inventories on future projects. 

1.4 OBJECTIVES 

The objectives of this study are twofold: (1) to evaluate ISOCLS and CLASSY 

for land cover classification, and (2) to determine the classifier to use In 
other AgRISTARS Program test sites. 
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2. DESCRIPTION 


The study area selected for the ISOCLS-CLASSY comparison Is in the Clearwater 
National Forest (Region 1) cf northern Idaho (figure 2-1). Upon the request 
of AgRISTARS for an srea co test various remote sensing systems, the Clear- 
water National Forest staff selected the Elk River 7-1/2-minute quadrangle 
(1:24,000). This stud 1 ' area, located approximately 83 kilometers northeast of 
Moscow, Idaho, represents a complex heterogeneous site of the northern Rocky 
Mountain coniferous forest. The climate, topography (elevation, aspect, and 
slope), and soils combine to produce coniferous cover types of mixed conifer, 
western white pine (Pinus monticola) , western larch (Larix occidentalis , 
Douglas-fir f r'seud - ■■ suga menziesii ) , sub-alpine fir-spruce ( Abies lasioaama - 
Picea e ntjelntar'iii ) , western red cedar ( Thuja vliaata) , and mountain hemlock 
( Lari.;: mertensiana) . The most abundant is the mixed conifer type, in which a 
single species is not dominant and the amount of each species in the mixture 
varies by location. Some of the species that may occur in the mixed type are 
western larch, Douglas-fir, grand fir ( Abies gvandis ) , western red cedar, wes- 
tern white pine, ponderosa pine (Pinus yonderosa ), Englemann spruce (picea 
engelmartnii ) , lodgepole pine ( pinus aontoria) , and sub-alpine fir. Associated 
species of the larch type may include western red cedar, grand fir, Douglas- 
fir, ponderosa pine, and western white pine. Grand fir occurs with the west- 
ern red cedar type, and Douglas-fir and mountain hemlock occur with the sub- 
alpine fir-spruce type. Associated species of the mountain hemlock type in- 
clude lodgepole pine and whitebark pine (pinus albiaaulis ). 

Other land cover/land use classes In the quadrangle area Include clearcuts, 
riparian area, urban area (town of Elk River), meadows, and water (Elk Creek 
Reservoir). The clearcuts, which vary in size and composition, occur through- 
out the quad, but are most common on the west half. Most clearcuts have 
shrubs as the dominant vegetation, but may also have rock outcrops, large 
cedar stumps or overtopping regeneration of Dourglas-flr, sub-alpine fir, 
lodgepole pine, and Englemann spruce. The most dominant shrub In some clear- 
cuts is shlnyleaf (csanothus velutinus) or redstem ceanothus (Ceanothue 
sanguineous ) . Other shrubs that may be dominant or occur with the ceanothus 
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Figure 2-1.- Elk River test site In northern Idaho. 


types are elderberry ( Sambuoae aaemtlea) , willow ( Salix f.pp), Rocky Mountain 
maple (Acer glabrum) , alder ( Alnue sinuata ), and ninebark [PhysoagryuB 
mlvaaBue) . The riparian area Is a cottonwood-willow type { Poyulue 
trtchooawa-Salix spp), and the meadows contain grasses, sedges, forbs, and 
shrubs. Some species occurring In the meadows are Idaho fescue ( Fe8tuaa 
idahoeneie ) , bluebunch wheatgrass ( Aavopuyon evicatum ), sedges (Carex spp), 
yarrow ( Achillea mlletolium) , goatweed [tiuverneum perforatum) , wild straw- 
berry (Fraaaria veeoa) , and snowberry ( Sumphoriaarpoa gibus) * There are wet- 
land species of cattail ( Tuvha lati folia) , bulrush {Se-Hyua spp), duckweed/ 
waterllly {Lermna spp /Nuvha spp), and willow, where Elk Creek empties Into Elk 
Creek Reservoir and along the fringe of the reservoir. 

All five of the management units for the Elk River Planning Unit (Palouse 
Ranger District) are represented In the stuflty quad. The management units are 
Elk River foothills, granitic uplands. Elk Creek breaks, Intermediate moun- 
tain-slope lands, and high-ridge lands. The elevation In the stucfy area 
varies from 0 to 10 percent In the valleys to 60 percent plus on the mountain 
faces. 
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3. METHOD 


The objective of thli study was to compare two unsupervised techniques, or 
clustering algorithms, on one 7-1/2-mlnute quadrangle In northern Idaho. The 
data sources were satellite digital radiometric values, stored on computer* 
compatible tape (CCT). 

3.1 DATA SELECTION 

Digital tapes of the Landsat Imagery (ID-293317281) of Idaho were ordered from 
Goddard Space Flight Center (GSFC) under the AgRISTARS program. Landsat digi- 
tal tapes from August 12, 1977, were selected because they represent the peak 
of forest development and are high quality, cloud-free tapes. The color 
Infrared (CIR) optical bar camera (OBC) aerial photographs that will be used 
to evaluate classification accuracy were taken August 29, 1978. An orthophoto 
quad (made with aerial photographs taken September 24, 1975) of the Elk River 
test site will also be used to supplement the CIR photographs. 

3.2 PREPROCESSING 

The Elk River data set represents a 132-square-kilometer area that Is recorded 
on 28,731 data points or samples. Each data point represents approximately 
0.45 hectare on the ground. Digital tapes from GSFC were sent to LARS to be 
reformatted Into a Universal format and to perform a geometric correction of 
the Elk River data set. Pixel -radiance values were resampled, using the 
nearest -neighbor rule. 

3.3 PROCESSING 

All digital processing was done on LARS remote terminals located In JSC Build- 
ing 17. The LARS host computer at Purdue University, West Lafayette, Indiana, 
Is an IBM 3031 (formerly an IBM 370). The software to run the hardware Is 
called LARSYS, and the version used at JSC Is E00-LARSYS. 
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3.3.1 CLUSTERING 

The two clustering algorithms selected for the study were ISOCLS and CLASSY. 
Both algorithms have been used at JSC for LACIE. Basically, a clustering 
algorithm searches for the Inherent separability or structure of the data 
without any prior knowledge or training; this process Is opposed to a 
supervised technique, which does require training to separate the data. 

ISOCLS Is a clustering algorithm that Is similar to ISODATA developed by Ball 
and Hall (ref. 1). If seeded, or starting, vectors for the desired Informa- 
tion classes are not used, then the algorithm Initializes Its own spectral 
class mean and, according to the specified parameters, tries to partition the 
data set Into spectral class groups. Unknown samples are compared to deter- 
mine the group to which they belong (to which spectral class mean vector they 
are closest, using the city block, or LI, distance); If necessary, a new group 
Is created, to which the sample Is then assigned. After one Iteration through 
the data, the mean vectors of the spectral classes are recomputed. The first 
Iteration through the data may terminate with only two or three cluster clas- 
ses, but subsequent Iterations will probably produce more cluster classes 
through a sequence of splitting, combining, and chaining operations. The main 
difference between ISOOATA and ISOCLS Is that I300ATA does not have the chain- 
ing operation. For a more In-depth description of ISOCLS see Kan (ref. 2). 

The number of cluster classes that Is produced for a given data set depends, 
of course, on the data set complexity and selection of parameters. With 
ISOCLS *>any parameters can be varied to produce different results. For 
example, changing STDMAX from 4.5 to 3.0 will result In more cluster classes, 
and setting DLMIN (the distance between cluster centers) from 3.2 to 2.0 will 
also Increase the number of cluster classes produced. Other parameters that 
can be varied Include ISTOP (number of Iterations); NMIN (minimum number of 
samples In a spectral class on the first and next-to-la$t Iteration); PHIN 
(mini mean number of samples In a spectral class at the last Iteration); maximum 
number of clusters; and percent N [the percents:?’ of stabilized clusters with 
standard deviations less than the threshold parameter or STDMAX (maximum 
standard deviation) In the Initial split Iteration sequence]. Since all of 
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the parameters are Interrelated, changing any one of them Mill alter the 
results; thus, finding an optimum set of parameters for a given data set Is 
difficult. 

CLASSY Is a more sophlsltlcated algorithm which alternates maximum likelihood 
procedures with splitting, joining, and eliminating operations (refs. 3,4,5). 
CLASSY starts with a model and assumes the data Is normally distributed. 

First, the data set Is scrambled so that samples may be randomly selected. 

The algorithm begins with parent clusters and then determines If the distribu- 
tion of the parent should be broken down Into subclusters or be malnta'ned. 

If the likelihood ratio Is higher for the parent than the subclusters, the 
parent cluster Is maintained. The CLASSY algorithm looks at four moments of 
the mixture density (histogram) to see If the cluster distribution assumes the 
normal bell shape. The moments looked at are mean vector, covariance matrix, 
skewness (the measure of symmetry of the tails of the curve), and kurtosls 
(the measure of the height of the peak of the curve or the flatness of the 
curve) . 

Even though CLASSY Is not on EOD-tARSYS, It can be run using the LARS version 
of the IBM Conversational Monitoring System (DC) 370. The only parameters 
the analyst can vary with CLASSY are the number of Iterations, the size of the 
smallest cluster (based on a percent of the data set), and the maximum amount 
of time the program Is allowed to run. CLASSY requires far more subroutines 
than ISOCLS. 

3.3.2 LABELING 

After final cluster maps were produced for each algorithm, the next step was 
to use 1:30,000 CIR OBC aerial photographs, stand maps, and the orthophoto 
quad for assigning Information classes to the spectral classes (or labeling). 

3.3.3 CLASSIFICATION 

The spectral class or classes that represented an Information class were then 
assigned an alphanumeric symbol. The resultant amp with Information classes 
becomes a classification mep. 
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3.4 GROUND TRUTH OR REFERENCE BASE 


The reference base for evaluating classification accuracy was primarily the 
1:30,000 CIR OBC Imagery. The QBC is a panoramic camera that produces expo- 
sures on a film strip that covers 3.7 by 59.5 kilometers (at nadir). Since 
there Is so much Inherent Image distortion In the Imagery away from the nadir 
(optical center of the film), a variety of equal-area grids have been devel- 
oped by the USDA Forest Service Geometronics group In Washington, D.C., for 
every other exposure of the overlapping stereo pairs. The grid selected for 
this study contained 1.01-hectare tick marks. 

After a preliminary manual photointerpretation of the 1:30,000 imagery, any 
cover types that could not be Identified were examined and verified during a 
field trip. 

3.5 EVALUATION PROCEDURES 

The accuracy of the ISOCLS and CLASSY classification maps were assessed with 
stratified random sampling. The strata such as grass, cut-over, and forest 
were delineated on an overlay registered with the orthophoto quad. The number 
of samples, or one-pixel test fields, in each stratum was determined according 
to the areal extent (in percent) that each stratum covered on the orthophoto 
quad. For example, if stratum 1 comprised 15 percent of the quad, then 15 
percent of the samples were taken in stratum 1. The locations of the test 
fields were marked on the classification maps, which could then be viewed on a 
light table after the orthophoto quad (positive transparency) was superimposed 
on them. The test fields in each stratum were evaluated according to the 
Landsat and the orthophoto quad - OBC solution. 

Confusion matrices for each classifier were generated, and errors of omission 
and commission were calculated. Overall and class-classification accuracies 
were also calculated. In addition, overall and class-mapping accuracies were 
calculated according to the method used by Kalensky and Schrek (ref. 6) While 
classification accuracy Includes only the omission error, mapping accuracy 
differs, in that It Includes both the errors of omission and commission. 


3-4 


4. RESULTS AND DISCUSSION 
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4.1 PREPROCESSING 

The general geometric correction produced by LARS resulted In line printer 
maps that had a systematic error of two to three pixels east to west and one 
to two pixels north to south. The greatest error was In the southwest corner 
of the quadrangle. An attempt was made to Improve the positional error with a 
precision registration, but the error was not improved because a sufficient 
number of well -distributed points could not be found. The Elk River data set 
Is In a relatively remote area that does not have well-defined roads, and 
stream Intersections were not reliable because many of the streams were low at 
the time of the Landsat overpass (August). 

4.2 PROCESSING 
4.2.1 ISOCLS 

Many runs of ISOCLS on the Elk River quadrangle were made with different 
parameters, but It became readily apparent that the Interdependence of the 
parameters would prevent the search for an optimum set of parameters. There- 
fore, it was decided that PMIN and NMIN would be set at -4 and 0, respectiv- 
ely, so that even a one-pixel cluster would be retained if It was unique. The 
maximum number of clusters allowed was set at 60, and N was set at 80 percent, 
based on LACIE studies (ref. 2). The OLMIN parameter was set at 3.2 after It 
was observed that values below this produced spectral -cl ass pairs that were 
separated by a DLMIN of less than the amount specified. 

The criteria for determining the best value of STDMAX were, first, how well 
the water pixels were separated from slope shadows and, second, whether the 
assortments of spectral classes were too numerous to be Identified and la- 
beled. Also, the ease of Identifying the meadows and th> town of Elk River 
was another factor In judging the algorithm’s performance. In essence, the 
analyst evaluated the cluster maps according to the data set's recognizable 
land cover features. The optimum number of spectral classes was found to be 
between 21 and 24, since aqy lower number resulted In water pixels all over 
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the maintain slopes and since cluster maps with more than 24 spectral classes 
did not have well-defined meadows. 

An attempt was made to separate out the forest cover types, but it became 
obvious that there was not a unique spectral class (or classes) for any of the 
forest types. Also, it would be beneficial if the various cut-over areas 
could have been discriminated because of their variability; but, again, this 
task was inpossible to do In this study. Most of the cut-over areas were 
clearcuts, but there were also selection and shelterwood cuts. Therefore, for 
the Elk River data set, the 24 spectral classes were labeled into the Informa- 
tion classes of Coniferous Forest, Cut-over, Grass (meadow), and Water. 

The overall classification accuracy using the ISOCLS clustering algorithms was 
81 percent, and the overall mapping accuracy was 60 percent (table 1). The 
classification and mapping accuracies for Coniferous Forest were 78 percent 
and 78 percent, respectively. Forest class was confused with Cut-over, Grass 
and Hcter. Most of the omission error was with Cut-over. It should be noted, 
however, that sane of the spectral classes that have been labeled Cut-over 
could indeed be low-density forests. The classification and mapping accura- 
cies of the Cut-over class were 72 percent and 55 percent, respectively. The 
omission error was equally divided between Coniferous Forest and Grass. This 
result Is not surprising, since the area receives high annual precipitation 
(114.3 millimeters and greater), and the cut-over areas (especially the clear- 
cuts) are quickly filled In with shrubs and grasses. Also, standing trees 
left on the cut-over areas contribute to the confusion with the Coniferous 
Forest class. The classification and mapping accuracies of the Grass class 
were 100 percent and 50 percent, respectively. Both Coniferous Forest and 
Cut-over contributed to the commission error. The classification accuracy of 
the Water class was 100 percent, but since some of the Coniferous Forest was 
classified as water, the mapping accuracy was only 80 percent. Since this 
error occurred along the edge of the reservoir. It could have been caused by 
pixel -positional accuracy or shadows near the water's edge. 
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4.2.2 CLASSY 


CLASSY was developed to be used for clustering agriculture crop areas, not 
wildlands. Since the largest data set It could previously cluster was a LAC IE 
segment (9 by II kilometers), software changes had to be made to do a quad- 
rangle-size data set. Because this was the first time CLASSY had been used In 
forest classification, the experience gained In agricultural work was used 
Initially to set the algorithm parameters. It was recommended that the number 
of iterations be between three and seven and the total run time be set at 150 
minutes (ref. 7). Three iterations were usually used for LACIE work, but 
since the data set was very heterogeneous. Initial trials were run with four 
and five iterations. When six Iterations were used, the algorithm converged 
better, so most of the runs were made with six iterations. Compared to 
ISOCLS, the smallest size cluster class that can be maintained is 1 or 2 per- 
cent of the data set. Using 28,731 samples, for example, the smallest cluster 
class at the 1-percent level would be 287 pixels, or samples. Theoretically, 
any cluster class smaller than this would not be retained at the end of the 
final iteration. Because of LACIE problems of running CLASSY with 1 percent 
of the scene, it was decided to use 2 percent of the scene as the smallest 
cluster class. Later, the 2-percent cluster size was changed to 1 percent. 

At the 2-percent threshold, only six cluster classes were produced. The Elk 
Creek Reservoir is between 50 and 100 pixels in area, so it was too small to 
show on the cluster maps. With the 1-percent threshold the number of spectral 
classes decreased from six to five, and the Water class was still too small to 
be separated. The resulting five spectral classes were labeled Into the in- 
formation classes of Coniferous Forest, Cut-over, and Grass (meadow). 

The overall classification and mapping accuracies using the CLASSY clustering 
algorithm were 77 percent and 67 percent, respectively (table 2). Though the 
Coniferous Forest classification accuracy was 12 percent higher than It was 
using ISOCLS, the mapping accuracy was 1 percent lower. Both Cut-over and 
Grass were confused with Coniferous Forest, but there was more omission with 
Grass than was the case with ISOCLS. Grass also contributed to a commission 
error for the Coniferous Forest class. The classification accuracy was 31 
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percent lower. Most of the Cut-over samples were actually Coniferous Forest. 
Pixel-positional accuracy and some of the problems already mentioned with 
ISOCLS contributed to the errors. The classification accuracy of Grass was 7 
percent lower than ISOCLS, yet a higher commission error resulted In a mapping 
accuracy that was 19 percent lower. Spectral response overlap between grass, 
shrub, and trees Is believed to result in the commission error for both ISOCLS 
and CLASSY. Since the Water class was too small to be discriminated by 
CLASSY, no water comparison can be made between CLASSY and ISOCLS results. 

Both ISOCLS and CLASSY Indicated that there was a grass meadow In the north- 
west portion of the quadrangle, but aerial photos showed that the area was a 
cut-over area which had grass between the remaining standing trees. The area 
In question Is not like the grass meadows In the southern part of the quad- 
rangle, which are frost-pocket areas (created by deforestation) that can no 
longer support tree seedlings. 

The Cut-over class Is very Important to forest managers, and any accuracy 
lower than 70 percent probably would not be acceptable to them. Recent cut- 
over areas have a better chance of being detected, especially the clean clear- 
cuts. However, as cut-over areas are filled In with grass, shrubs, or seed- 
lings, the chances for discrimination are decreased. More work needs to be 
done In this area since change detection and updating of geographic Informa- 
tion systems will greatly assist land-management planning In the future. 

If terrain data had been used, some of the Individual forest-cover types could 
have been separated, particularly the mountain hemlock and the Douglas-flr 
types. 

The classification and mapping accuracy of ISOCLS and CLASSY differ little, 
except for some of the classes. CLASSY requires more Central Processing Unit 
(CPU) time per run, than does ISOCLS; however, ISOCLS requires more trial and 
error runs, since It has so many parameters that can be varied. ISOCLS In the 
unseeded mode requires 10 to 20 runs to separate land cover/use classes com- 
pared to only two to three runs with CLASSY for a given data set. If ISOCLS 
Is used. It Is recommended that starting (seeded) vectors be used. 


4-4 


TABLE 4-1.- ACCURACY EVALUATION OF LANDSAT FOREST CLASSIFICATION USING 

ISOCLS CLUSTERING ALGORITHM 


Class 


Landsat 

Omissions 

Mapping 

a 

B . 

C 

El 

Total 

No. 

m 

accuracy 

Coniferous Forest (A) 

100 

13 

9 

6 

128 

22 

22 

78 

Cut-over (B) 

6 

31 

6 


43 

12 

28 

55 

Grass (C) 



15 


15 

D 

0 

50 

Water (D) 




24 

24 

0 

0 

80 

Total Indicated 

106 

44 

30 

30 

210 




Total committed 

6 

13 

15 

6 





Percent commission 

6 

30 

50 

20 





Overall classification 
accuracy 

81X 








Overall mapping accuracy 

69% 









TABLE 4-2.- ACCURACY EVALUATION OF LANDSAT FOREST CLASSIFICATION USING 

CLASSY CLUSTERING ALGORITHM 


Class 

Landsat 

Omissions 

Mapping 

D 

B 

C 

Total 

No. 

m 

accuracy 

Coniferous Forest (A) 

135 

5 

10 

150 

15 

10 

77 

Cut-over (B) 

24 

12 

9 

45 

33 

73 

24 

Grass (C) 

1 


14 

15 

1 

7 

41 

Total Indicated 

160 

17 

33 

210 




Total committed 

25 

5 

19 





Percent commission 

16 

29 

58 





Overall classification 
accuracy 

77% 







Overall mapping accuracy 

67% 
































5. CONCLUSION 


ISOCLS In a pure, unsupervised mode Is an ad hoc algorithm that requires many 
trlal-and-error runs to find the proper parameters, such as STDMAX, to sepa- 
rate desired Information classes. On the other hand, CLASSY Is a more refined 
algorithm, which .In a single run tells the analyst more concerning the classes 
that can be separated. One major drawback to CLASSY Is that Important forest 
and range classes that are smaller than a minimum cluster size will be com- 
bined with other classes; futhermore, the algorithm requires so much computer 
storage that only data sets as small as a quadrangle can be done at one time. 
However, CLASSY appears to show more promise for forest stratification than 
ISOCLS and shows more promise for consistency. This study Is not conclusive: 
more research needs to be done comparing the two algorithms in different areas 
and using any new Improvements to either ISOCLS or CLASSY. 
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